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and  State  University 

0.  Abstract.  Chebychev  inequalities  are  given  for  joint  central 
and  noncentral  distributions  of  k  quadratic  forms;  these  are  sharpened 
when  k*2  using  the  canonical  correlations  of  Hotelling.  Complementary 
inequalities  are  found  as  versions  of  Markov's  inequality.  Applica¬ 
tions  are  noted  in  ballistics,  in  statistical  quality  control,  in  estab¬ 
lishing  consistency  of  Gauss-Markov  estimates  under  dependence,  and  in 
constructing  conservative  joint  confidence  sets  depending  on  the  under¬ 
lying  distribution  only  through  its  low  order  moments. 

1 .  Introduction.  Chebychev  inequalities  are  fundamental  to  sta¬ 
tistical  theory  and  practice,  providing  connections  to  laws  of  large 
numbers  and  conservative  estimates  for  probabilities.  Collections  of 
quadratic  forms  arise  in  many  branches  of  applied  probability  and  sta¬ 
tistics,  for  example  as  amplitudes  of  random  signals  in  multichannel 
receivers  and  as  meausres  of  discrepancy  in  parametric  and  nonparametric 
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multiple  testing  procedures,  where  their  central  and  noncentral  distri¬ 
butions  assume  a  prominent  role.  Numerous  multidimensional  Chebychev 
inequalities  are  available  for  probabilities  of  deviations  from  means. 
However,  few  of  these  apply  to  distributions  of  quadratic  forms,  then 
only  in  the  central  case,  and  even  those  results  are  scattered. 

Here  we  develop  Chebychev  inequalities  for  joint  central  and  non¬ 
central  distributions  of  k  positive  semidefinite  quadratic  forms, 
extending  results  of  Wilks  (1962);  we  sharpen  these  bounds  for  central 
distributions  when  k*2  using  information  supplied  by  Hotelling's  (1936) 
canonical  correlations,  extending  work  of  Berge  (1937)  and  Lai  (1955); 
we  derive  complementary  inequalities  as  multidimensional  versions  of 
Markov's  inequality;  and  we  extend  some  of  these  findings  to  indefinite 
forms.  We  then  apply  these  inequalities  in  a  variety  of  problems  in 
statistics  and  applied  probability. 

2.  The  Main  Results.  Let  Y  ■  [Y^ , . . . .Y^] '  be  a  random  element 

in  R11  having  the  mean  u  *  [p -,..., p  ]'  and  the  nonsingular  dispersion 

i  n 

matrix  V(Y)  *  I  -  [o^],  and  ^et  , - . . be  ^  positive  semi- 
definite  matrices  of  order  (nxn) .  A  Chebychev  inequality  for  the  joint 
noncentral  distribution  of  semidefinite  quadratic  forms  in  Y  is  the 
following. 

THEOREM  1.  Let  Y  be  random  having  the  finite  mean  ^  and  dispersion 
matrix  £,  and  let  {B^,...,B^}  be  positive  semidefinite  (nxn)  matrices. 
For  each  0  e  Rn  and  each  positive  {5^ . 6^},  we  have 

KCX-oJVX-e)**! . (X-9>'Bk(Y-9)s6k)  *  i-4±+  ...  +  ^> 

k. 


where  -  trB^+^-J)  ’B^-0)  for  i-1,2 . 


Proof.  Let  Q^x)  -  (x~9)  ’B^-Q)  and  Q(X)  -  6“^  (X)+. .  .-W^O^x) 

and,  for  1*1, identify  the  sets  *  (xeRn|Q^(x)^^}  and 

A  ■  Ajn...nA^.  From  the  nonnegativity  of  {Qj^  » •  •  •  and  c^e 

definition  of  A,  we  infer  that  Q(X)  ^  0  for  all  ^  and  Q(X)  >  1  on 
c 

the  complement  A  of  A.  A  standard  computation  yields 

E[Q(X)1  -  /  „Q(x)dF(Z)  2:  /  0(X)dF(x)  >  /  dF(X)  -  l-P(A) 

AuA  AT  A 

with  F(X)  the  cumulative  distribution  function  of  Y,  and  it  remains  to 
evaluate  E[Q(y)].  A  routine  argument  gives  E[Q(Y)]  ■  <5^  [trBj£  + 

(E“£) ’Sj/E-^)!  +  •••  +  6k1[trBkL  +  (ji-0)  'Sj^E-S,)!  and  thus  the  theorem. 

It  is  known  for  certain  symmetric  unimodal  distributions  on  R11 
that  the  measure  of  a  convex  symmetric  set  diminishes  as  the  set  is 
moved  away  from  ji  along  a  ray  (cf.  Anderson  (1955)).  We  note  here  that 
a  similar  behavior  with  respect  to  ellipsoids  is  exhibited  by  any 
n-dimensional  distribution  having  second-order  moments,  in  the  sense 
that  the  guaranteed  probability  diminishes  as  (}J“9) 'B(ji-0)  increases. 
This  is  a  consequence  of  the  following  corollary;  if  in  addition  0*ji 
and  B*E  *,  the  corollary  yields  P( (Y-jj)  ' E  ^(Y-ji)s6)  2  l-n/5  as  given 
in  Wilks  (1962;  p.  92). 

COROLLARY  1.1.  If  X  be  random  with  parameters  (jj,£),  then  for  each 
£eRn,  each  6>0,  and  each  positive  semidefinlte  matrix  B, 

P((Y-0)'B(Y-0)S6)  2  l”ftrB£+(ji-0)  ’B(}i-9)]  /S . 


4 


\ 
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Many  applications  entail  definite  quadratic  forms  in  subsets  of 

the  elements  of  Y.  Partition  Y-  [y| . Y^]  ' ,  jj  -  [jj  [ , . . .  ,j^]  ' , 

§.  m  [&!»•••  * »  and  E  *  conformably,  with  Y^  of  order 

(m^xl)  and  mj+...+m^  ■  n,  and  choose  block-diagonal  matrices 

of  the  cypes  Si  ■  Dia8  S±  “  Diag  (0,^,0),  and 

with  gi  conforming  to  for  i«l,...,k.  Theorem  1 
yields  the  following  useful  corollary,  a  special  case  of  which  was  given 
in  Wilks  (1962;  p.  274)  when  k“n,m^  ■  ...  «  m^  *  1,  and  9my,. 


Bk  -  Diag  (0,^) 


COROLLARY  1.2.  Let  Y  *  [Y  j .... .Y^] '  be  random  having  the  mean 
Ji  ■  [^i  j , . . .  .jj^]  '  and  the  dispersion  matrix  £  *  [£^],  ant*  ^et 
^i^miXmi^ ’  » • • • be  positive  semideflnite  matrices.  Then  for 

each  9  ■  [j0  * , . . .  ^  and  each  positive  {5j,...,6k},  we  have 


P((X1-91)'E1(Y1-01)S61 

where  y.  -  trE.Z..  + 
1  ~i~li 


. 17  + 

^i^i*  ^i^i”®!*  for  i-1 . k. 


Our  inequalities  thus  far  pertain  to  events  of  the  type  A  * 
^^iQl  (z)s5i»  •  •  •  Complementary  Inequalities  have  to  do 

with  P(Q^(Y)2:<S  j , . . .  ,Qk(Y)2i5k) .  To  establish  such  inequalities  we  pro¬ 
ceed  as  follows.  Let  X  be  random  with  values  in  a  linear  space  X;  let 
XqcX  be  fixed;  induce  a  partial  order  sxy  on  X  which  is  reflexive 
and  transitive;  and  call  a  real  valued  function  g(*)  on  X  monotone  if 
x«y  implies  g(x)£g(y).  The  following  general  version  of  Markov's 
inequality  is  given  in  Jensen  and  Foutz  (1978). 


LEMMA  1.  Let  Xq£X  be  fixed,  and  let  be  the  class  of  non-negative 
monotone  functions  on  X  depending  on  ?(*)  such  that,  for  each  ge§g, 
E[g(X)]  is  defined.  Then 

P(XHC  )  <;  inf  E[g(X)]/g(X  ). 

% 

To  complement  Theorem  1  we  identify  X  as  Rn;  we  induce  a  partial 
order  on  Rn  with  respect  to  the  positive  semidefinite  matrices  {B^, 

. . . ,B^}  on  stipulating  that  x  £  if  and  only  if  x'B^x  £  for 

all  ial,...,k;  we  choose  for  convenience  the  monotone  function 
g(x)  ■  x'Bx  with  B  ■  B.+...+B,  ;  and  we  further  assume  that  the  several 
statements  {x'B^x  >  6^,...,x'B^x  S  5^}  are  consistent.  On  letting 
xQ  £  R11  be  any  point  for  which  equality  is  achieved,  i.e.,  {x^B^x^  ■ 

, . . . jX^B^Xg  *  6fc},  we  apply  Lemna  1  directly  to  establish  the  follow¬ 
ing  inequality  complementary  to  that  of  Theorem  1. 


THEOREM  2.  Let  Y  be  random  having  the  finite  mean  jj  and  dispersion 
matrix  Z,  and  let  {B^,...,B^}  be  positive  semidefinite  (n*n)  matrices. 
For  each  0  s  Rn  and  each  positive  {5 ^,...,6^},  we  have 


Y  +...+Y 

P((Y-9)  'B.  (Y-0)>6.  , .  . .  ,  (Y-0)  'B.  (Y-0)>5,  )  5  - - 

- ~1 - 1’  - ~k - k  5,  +  .. .+6, 

1  k 


where  y±  -  trj^I  +  (ji-0)  for  i-l,...,k. 


Theorems  1  and  2  are  basic  to  the  present  study,  applying  to  joint 
distributions  of  positive  semidefinite  quadratic  forms  with  bounds  de¬ 
pending  in  part  on  the  traces  of  specified  matrices.  We  next  inquire 
whether  comparable  inequalities  may  be  found  for  indefinite  quadratic 
forms,  and  whether  the  bounds  given  may  be  sharpened  on  using  more 


I 


information  about  dispersion  parameters.  Both  questions  are  answered 
affirmatively  under  the  conditions  set  forth  in  the  paragraphs  following. 

Suppose  are  the  matrices  of  indefinite  quadratic 

forms  and  they  commute.  Then  {B^,...,B,  }  are  reducible  to  diagonal 
arrays  by  the  same  orthogonal  matrix  g(nxn),  and  it  thus  suffices  to 
consider  a  canonical  form  in  which  {§^,...,8^}  themselves  are  diag¬ 
onal  and  Y  has  the  dispersion  matrix  V(Y)  =  H  ■  g'gg.  Let  {gj",..., 
g£)  be  the  diagonal  matrices  obtained  on  replacing  all  negative  ele¬ 
ments  of  {B^,...,B^}  by  zeros  in  the  canonical  form  of  the  problem; 
observe  that  {x'D^x  £  6  ^  , . . .  ,x'd£x  £  6^}  implies  {x'B^x  <  <5^,..., 
x'B^x  <  6^};  and  use  earlier  results  as  they  apply  to  the  positive 
semidefinite  forms  {x'D+x, . . . ,x'D+x} .  An  amended  version  of  Theorems 
1  and  2  is  the  following;  versions  of  the  corollaries  follow  similarly 
without  difficulty. 


THEOREM  3.  Let  Y  be  random  having  the  finite  mean  jj  and  dispersion 
matrix  E,  and  let  {B^,...,B^}  be  indefinite  commuting  matrices  reduc¬ 
ible  to  the  diagonal  arrays  {D^ , . . . ,D^} .  Then  for  each  9  e  Rn  and 
each  positive  {5 ^,...,6  },  we  have 

X1  Xk 

p<(2-9),Sl(Y-e)s61,...,(Y-0),Bk(Y-9)s6k)  2  I-(  ^  +. . .+  ) 

°1  °k 

and 


X  •  ^  X . 

<x-y 'Vi-a>*y  * 


where  ■  trD+H  +  u'D*n»  D*  is  the  positive  part  of  the  diagonal 
matrix  g^  *  2'5j2  with  other  elements  replaced  by  zeros,  rj  *  2'(y,-9), 


In  order  to  sharpen  Chebychev's  inequality  through  the  use  of 
further  information  about  dispersion  parameters,  we  consider  the  spe¬ 
cial  case  of  the  problem  treated  in  Theorem  1  with  k=2,  e«ji, 
and  This  case  leads  naturally  to  a  reduced  form  in  which  the 

canonical  correlation  parameters  of  Hotelling  (1936)  assume  a  prominent 
role.  Our  main  result  is  the  following. 

i  »  » 

THEOREM  4.  Let  Y  *  [Y^Y^  be  random  of  order  r  +  s  =  n,  with 

1  t  1 

r  £  s,  having  the  finite  mean  »  t*ie  dispersion  matrix 

Z  **  [E..1,  and  the  canonical  correlations  {p,,...,p  }.  For  each 
~  ~ij  1  r 

positive  {5^,52},  we  have 

P(C^1"Ji1)  (Y2-Ji2)  ’E“J(Y2-ji2)^62)  >  1-R(61,62;£) 


where  £»  [p1,....Prl'  and 


R(<S1,62’£)  =^6_^'+  1  H61+62)+[(d1+62)2-4p26152]is}/26162. 


r  1  ?  ,  f 

Proof.  Choose  symmetric  square  roots  and  let  Z  ■  IZ^.ZjJ  such  that 

h  “  and  ~2  =  £22(~2-ii2);  observe  that  E(V  *  S> 

ECZ^)  *  Ir,  ECZ^)  -  R12  -  and  E(Z2z’)  -  Ig;  and,  by 

invariance  of  zjz^  and  Z2Z2  under  orthogonal  transformation,  choose 

orthogonal  matrices  P(rxr)  and  2(sxs)  so  as  t0  achieve  the  singular 

decomposition  PR,.,Q  ■  D  *  [Diag(p ,  , . . .  ,p  )  ,0]  ,  where  {p.,...,p  } 

~  i  r  ^  1  r 

are  the  canonical  correlation  parameters  of  Hotelling  (1936).  In  ca- 

k  h 

nonical  form  with  “  PZ^/6^  and  U2  *  Q^2^2’  ^  su^^^ces  to  demon¬ 

strate  that  P(A)  s  1  — R ( 6  ^ ,  6 2 ; ^)  ,  where  A  ■  {u|UjU^l  ,U2U2^1}  and  Ac 
is  its  complement.  To  this  end  consider  g(u;t)  ■  u'[G(£)]  *u  as  a 
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function  of  the  adjustable  parameters  t  ■  [t^,...,t  where  G(t)  = 

[Gij  ( t)  ]  is  a  partitioned  matrix  with  G^(t)  ■  1^,  §22 (t)  =  Ig ,  and 

”  22iC£)  *  [Diag(t j , . . . .t^) ,0]  *  T;  and  provided  ] t± |  <  1 
(which  we  henceforth  assume),  observe  that  g(u;t)  £  0  for  all  u  and 

that  g(u;t)  >  1  for  u  e  AC.  These  assertions  follow,  the  first  from  j 

the  positive  definite  character  of  G(t)  ,  the  second  on  completing  the  i 

square  as  g(u;t)  *  u^[gn(t)]  ^u^  +  S,  for  example,  S  being  a  positive 
semidefinite  quadratic  form.  We  accordingly  have 

=  /  g(u;t) dF(u)  >  /  g(u;t)dF(u)  >  /  dF(u)  =  l-P(A) 

AuA  A  A 

and  it  remains  to  evaluate  E[g(U;t)]  «  tr[G(t)]  *Q,  where  0  =  [g^]  “ 

V(U),  Su  =  Ir/5i»  S12  =  2/5i52’  3114  ~22  =  ~s/<S2‘  A  reduction  usin8 

partitioned  matrices  yields 

E[g(U;t)]  -  tr(Ir-TT')“1/61-tr  TClg-I’T)'^’ /6^-tr  T' (I^TT^'V6!^ 

+  tr(I  -T'T)-1/5_ 

~S  ~  ~  Z 

which,  from  the  special  structure  of  T  and  D,  becomes 

E[g(fi;£)]  *  [(ST^:1)  -  2p.t/«W]/(l-t2). 

°2  i*l  1  1  1  L  1 

On  varying  t,  we  obtain  the  smallest  bound  by  minimizing  E[g(U;t)]  with 
respect  to  {t^,...,tr).  Term-wise  differentiation  yields  the  solutions 

Ci  “  {<5i+62)  "  [(5l+62)2  "  4pi5i62]JS}/2pi5l62  8atlsfyla8  |tj  <  1; 
when  substituted  into  an  earlier  expression  these  give  the  required 

bound. 

When  <5^  ■  6^  *  6  the  bound  simplifies  as  follows. 

I 


****** 
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COROLLARY  4.1.  For  each  6  >  0  we  have 

-1  -1  r  i' 

P((Y1-El)'Z11(Y1-]!il)<6,(Y2-i.2)'E22(Y2-ii2)<6)  >  l-[s+  Z  (1-p J)  2] /5. 

" '  i=  1 

It  may  be  noted  from  the  proof  that  Theorem  4  provides  the  best 
bounds  available  depending  only  on  dispersion  parameters.  Theorem  4  is 
stronger  than  the  corresponding  version  of  Theorem  1,  yielding  the  lat¬ 
ter  when  ■  ...  =  =  0.  When  r  =  s  =*  1,  Theorem  4  yields  a 

result  of  Lai  (1955)  and  Corollary  4.1  a  result  of  Berge  (1937)  in 
terms  of  the  simple  correlation  parameter  p. 

3.  Applications.  The  foregoing  inequalities  apply  in  a  variety  of 
problems  in  statistics  and  applied  probability.  Some  examples  follow. 

3.1  Ballistics.  Given  random  impact  coordinates  having  an  arbi¬ 
trary  dispersion  matrix,  the  probability  of  hitting  an  elliptical  tar¬ 
get  may  be  rephrased  in  terms  of  the  distribution  of  a  definite  quad¬ 
ratic  form.  Joint  distributions  of  such  forms  arise  in  connection  with 
salvos  and  multiple  independently  targeted  reentry  vehicles.  In  the 
case  of  a  salvo  of  shots  subject  to  a  common  aiming  error,  the  required 
joint  probabilities  are  determined  by  noncentral  distributions  of 
definite  quadratic  forms. 

In  particular,  let  {^ , . . .  be  the  points  of  impact  of  k  shots 

all  aimed  at  the  same  point  £  but  intended  for  a  target  A  =  (xUx-x)' 
B(y-x)S6)  with  center  at  x.  Suppose  the  dispersion  matrices  V(y^)  = 

Z  are  equal  for  i**l,...,k,  but  no  other  constraints  are  imposed  on 
the  joint  distribution  of  » • • • •  A  routine  application  of  Corol¬ 
lary  1.2,  with  jj  *  £  and  9^  *  x  for  i=l,...,k,  yields  the  bound 
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P(E)  s  ky/<$ 

for  the  event  E  that  one  or  more  shots  miss  the  target,  where  y  = 
trBZ+(£-x) ' B(f-x) .  Perhaps  more  useful  is  the  probability  that  one  or 
more  hits  are  scored;  from  Theorem  2  comes  the  bound 

P(S)  ^  1-y/S 

for  the  probability  of  the  event  S  that  one  or  more  hits  occur.  We 
note  that  both  bounds  may  be  improved  by  centering  the  impact  distri¬ 
bution  on  the  target  center,  thereby  eliminating  the  noncentrality 
parameter  (£-t) from  the  bound  and  guaranteeing  a  smaller 
value  for  P(E)  and  a  larger  value  for  P(S).  Whereas  probabilistic 
analyses  of  ballistics  systems  usually  are  carried  out  under  Gaussian 
assumptions  (cf.  Eckler  (1969),  for  example),  the  foregoing  develop¬ 
ments  apply  to  all  joint  impact  distributions  having  moments  of  second 
order. 

3.2  Statistical  Quality  Control.  The  variability  of  an  industrial 
production  process  often  is  monitored  using  S2  charts  based  on  under¬ 
lying  Gaussian  distributions.  Let  be  vectors  of  n  obser¬ 
vations  drawn  on  successive  occasions;  let  be  the  corre¬ 

sponding  sample  variances;  and  let  a2  be  the  control  variance.  The  S2 
chart  is  a  graph  of  {S2,S^,...}  against  time  on  the  horizontal  scale; 
the  process  is  asserted  to  be  out  of  control  and  corrective  action  is 
taken  whenever  S2/a2  exceeds  the  control  limit  c^.  Operating  charac¬ 
teristics  are  determined  by  the  distribution  of  the  run  length,  i.e. 
the  number,  N,  of  successive  samples  drawn  before  the  chart  signals 
that  the  process  is  out  of  control.  When  {Y^,^,...}  are  independent 
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and  identically  distributed,  whatever  the  underlying  distribution,  the 
run-length  distribution  is  the  geometric  distribution  G(t;cO  with  para¬ 
meter  a  «  P(S2/a2>c  ) . 

i  0  a 

On  choosing  0  ■  u  and  B  *  I  -n  ^1  1',  where  1*  ■  [1,...,1] 

^  **  ~  ~n  ~n~n  “ 

is  n-dimenslonal,  we  infer  from  Corollary  1.1  that 

P(S2/o2>c  )  s  1/c 
i  0  a  a 

when  the  process  is  in  control.  Moreover,  because  the  family  {G(*;a); 
ae(0,l)}  of  geometric  distributions  is  stochastically  decreasing  in  a, 
we  get  the  universal  stochastic  lower  bound 

P(N>t)  a  l-GCtjc"1) 

for  every  run-length  distribution.  Similar  conclusions  apply  when  the 
process  is  not  in  control  and  a 2  >  Oq  . 

3.3  Weak  Laws  of  Large  Numbers.  Let  {Y^Y^,...}  be  n-dimensional 
outcomes  in  a  sequence  of  experiments  having  homoscedastic  errors 

uncorrelated  on  successive  occasions.  We  study  consistency 
properties  of  the  Gauss-Markov  estimator  13^  ■  (X'X)  *X'Y^  under  the 
assumed  model  Yi  -  Xg-)^,  given  that  the  actual  model  is 

Xt  -  Xg  +  ziX  +  • 

Let  jSjj  -  •  .+IN)  J  observe  chat  2(^-6)  -  N  L(X'X) 

and,  using  the  uncorrelatedness  of  successive  error  vectors,  compute 

the  dispersion  matrix  VCg^)  ■  N  *a2M  with  M  ■  (X'X)  *.  From  Corol¬ 


«*> 


lary  1 . 1  we  have 
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p(IIIn-aII>c) 


j2trM 

Ne2 


X  S»j  SjjX 

- T2 - 


•  1  —  1  W 

where  | |  | j  is  the  Euclidean  norm  and  ■  N  (X'X)  X*  E  Z  .  If  we 

~S  ~  ~  ~  i.-T1 

_1  N 

now  suppose  that  lim  G„  ■  0,  i.e.,  lim  X'(N  E  2.)  “  0,  we  find  on 
N-hx>  N-*»  ~  i-l~1 

taking  limits  that  is  weakly  consistent  for  £.  In  particular,  if 
Z.  *  Z  and  X’Z  ■  0,  then  §  is  clearly  consistent.  Note  that  this 
approach  avoids  the  usual  assumption  that  {Y^,^,...}  be  mutually 
independent  and  that  the  model  be  correct. 

3.4  Simultaneous  Confidence  Bounds.  In  a  random  sample  of  n  obser 

vations  from  some  scalar  distribution  having  the  mean  y  and  variance  a2 

let  Y  and  S2  respectively  be  the  sample  mean  and  variance.  On  choosing 

B.  -  (no2)'2!  1'  and  B,  -  [(n-l)a2]_1(I  -n_1l  j/) ,  we  apply  Theorem 
i  ~n~n  i.  ~n  ~mi 

1  directly  to  obtain  the  bounds 


P(|  Y-el^aSj.S2/^^^2)  >  l-[ 


(u-e)2 

~^sY 


+  jz  1 


When  inverted  using  9  *  y  this  gives  a  bound  on  the  joint  confidence 
coefficient  for  a  region  yielding  two-sided  limits  for  y  and  a  one¬ 
sided  limit  for  a2 .  We  note  that  no  further  improvement  of  this  bound 
is  available  from  Theorem  4,  owing  to  the  fact  that  n*Y  is  uncorrelated 

with  each  of  the  residuals  { (Y. -Y) , . . . , (Y  -Y)}. 

i  n 
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